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STYLES AND STRATEGIES OF LEARNING 


By G. PASK 
(System Research Ltd., Richmond, Surrey) 


Summary. Previous results are reviewed and two series of experiments on learning 
are described, one carried out in the laboratory, and the other in educational 
institutions. | Both series use ‘conversational’ systems which allow mental 
activities to be described in terms of dialogue and behaviour. Several types of 
result are reported: (a) the significance of understanding; (4) the existence of, and 
variations in, learning strategies ; (c) the effect of matching and mismatching a 
teaching strategy to an individual’s learning strategy; (d) the nature and classifica- 
tion of cognitive style; and (e) transfer effects and ‘learning to learn.” A 
theoretical basis is developed for a classification of learning styles. 


PREVIOUS WORK. USING CONVERSATIONAL TECHNIQUES 


AN earlier paper (Pask, 1976) introduced conversational techniques, some 
involving a human participant in dialogue with a student, others involving a 
mechanically or computer implemented ‘ participant * through which the student 
‘ talks to himself’ under restrictions imposed by the device. In either case 
(human or mechanical monitoring) the subject matter of a conversation is 
represented in a liberally conceived, but standard, fashion, as a conversational 
domain consisting in an entailment structure (embodying one or more description 
schemes and indicating the many ways in which one topic may be known in terms 
of or derived from others) and behaviour graphs (one for each topic in the domain) 
that prescribe what may be done to model or explain the topic in question. 
Within this framework, the conversational techniques secure, or approximate, a 
standard condition for experiments on learning. If a topic is learned then it is, 
in a technical sense, understood. The requirement that ‘ learning a topic’ means 
“understanding a topic’ is as strong as, or stronger than, a requirement for 


oie. processing ’ as described earlier in the symposium by Marton and Saljé 


Analysis and justification of the understanding requirement led to psycho- 
logical postulates; for example, that a concept is a procedure for realising a 
topic relation and a memory is a procedure for reproducing a concept. The entire 
framework of postulates is specially tailored to accommodate educationally 
realistic learning and allows the formulation of hypotheses about style, learning 
strategies, teaching strategies, generalisation, retention and the like, which can 
be tested within the standard condition (see Pask, 1976) of a conversational 
system. The verified interlocking hypotheses are an interpretation of ‘ conversa- 
tion theory,’ (Pask, 1975a, 1975b). Some predictions have already been tested, 
using the conversational system as an experimental paradigm. Later and on- 
going experiments, based upon similar predictions, are described in this paper. 


Earlier studies of learning and teaching using conversational techniques 


uncovered several consistent tendencies. The main findings of previous studies 
are summarised below and their statistical significance is reported in Table 1. 
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TABLE 1 


SUMMARY OF PREVIOUS FINDINGS ON CONVERSATION LEARNING. 


(I) Students classified as holist and serialist on 
‘ Taxonomy ’” task. 


dap Students instructed in matched and mismatched 
fin by programmed test for approximately 
ours. 


(I) Students classified as holist and serialist, learning 
(probability theory) on CASTE under fixed teaching 
strategy for approximately 8 hours. 


(IV) Students learning probability theory on CASTE 
under three different conditions of learning. 
(Matched condition as in III) 


(V) Students learning septa ty theory on CASTE, 
uncertainty regulation and free learning. Change i in 
average uncertainty per topic (AH). 


| (VD 


ad in average value correct belief per topic 


Free learning - 


Mean =52:2% 





a 


Effective Teachback 
Mean 28-5 (Max. 30) 


SD=1-0 N=8 


Matched 
Mean =29°5 (max ve 
SD=0:3 
Matched — 


Mean=61 (max. 100) 
SD=4°8 - N=8 





SD=4°8 
N=8 


SD=25-6. 
N=10 


Transfer 


Ist part of learning 
MeanAH=0-97 
SD=0-49 | . N=20 


Fonsi oe 8 
D=—022 N=20., 


Mean=13-7 (max. aa! 
N= 


Mean=31°-5 (max. 100) 
. SD=6'1 N=8 


Matched strategy | 


Mean=61% 


Retention Test Scores 
Ineffective Teachback 
Mean= 16-1 (max. 30) 
SD=3-4 N=8 
Mismatched 


SD=3°8 


Mismatched 


Uncertainty’ 
Regulation 


Mean=96 % 


SD=5°6 
N=10 





Data 





2nd part of learning 
MeanAH =0:22 
SD=0-23 


MeanA@=0:22 
SD=—0-06. 





Matched > mismatched 


a 


Significance 


Effective > Ineffective 
P<0-01 
Mann-Whitney U test. 


Matched > mismatched 
P<0-001 
Mann-Whitney U test. 


P<0-001 
Mann Whitney U test. 


Vd /D 


Uncertainty regulation> 
Free learning P<0-001 
Uncertainty regulation> 
‘Matched strategy 
P<0-001. 

Mann Whitney U test. 


Ist half>2nd half . 
P<0-05 
Mann Whitney U test. 


2nd half> Ist half 
P<0-005 oO: 


‘Mann Whitney U test. 
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(1) Concepts of topics that are understood in the strong sense of the first 
paper (i.e., for which the learner has given an explanation and a derivation) are, 
in fact, stable. Not only are the concepts protected from interference whilst 
Jearning is confined to one conversational domain, they are also reliably 
Tetained, as judged by post-tests after two weeks or more which emphasise 
explanatory recall. 


: (2) In a conversationa] system, whether humanly or mechanically instru- 
meated, students are forced to make explicit their learning strategy, because of 
the understanding requirement. Under these conditions learning strategies ane 
polarised into mutually exclusive classes which have been termed holist and 
- gerialist. Having adopted one kind of strategy the student does not relinquish it 
(even though he cannot successfully execute it) unless strong advice is provided 
or he learns about a different domain where he can start afresh. Sharp strategic 
distinctions occur because students become locked into one strategy to the 
exclusion of others, a phenomenon similar to Festinger’s (1957) ‘cognitive 
dissonance *, 

If learning is controlled in the way described in the previous paper (e.g., the 
CASTE or INTUITION systems), the holist and serialist strategy classes can be 
characterised by potentially independent empirical criteria, 


The holist has many goals and working topics under his aim topic; the 
serialist has one goal and working topic, which may be the aim topic. Holist 
strategies are shown in Figure | in which each frame represents the understanding 
of one topic. Evidence suggests that the holist is assimilating information from 
many topics in order to learn the ‘ aim’ topic, while the serialist moves on to 
another topic only when he is completely certain about the one he is currently 
studying. 

There is ample evidence that holist students entertain beliefs (often correct 
beliefs) about topics other than the working topics or the aim, while serialists 
have little or no idea about other topics. Holists thus tend to discover a global 
description of topics, or to invent a description compatible with the conversa- 
tional domain, while serialists only describe the topic for which they are com 
structing an explanatory model. 


Under * teachback’ conditions (where verbal explanations are elicited) a 
finer, though less objective, discrimination is possible by content analysis of 
the spoken utterances. Holist students ask questions about broad relations and 
form hypotheses about generalisations. Serialists ask questions about much 
naryower relations and their hypotheses are specific. Amongst the holists, some 
(redundant holists) invent description schemes of their own. Irredundant holists 
still use many descriptors but these are relevant and coherent. 

The following illustrations are drawn from a conversationa] domaip 
concerned with an imaginary species of animal (the Gandlemuller) and its 
behaviour, feeding habits, anatomy, and so on. They are typical of these 
different jearning strategies. 

Serialist .,.‘* Gandlers have no sprong” or, the interrogative forms ‘“* Do 
Gandlers have sprongs?’ or ‘“‘ Which kind of Gandlemuller has no 
sprongs .. .?” 

Holist ...“* There are more kinds of Gandler with mounds (dorsal or cranial) 
then Piongers ” or, the interrogative form “ Are there more kinds of . . 2” 

Redundant Holist ...‘* The ones that were discovered first are gentle; the 


other kinds, the aggressive beasts found Jater, well they are the ones with 
Jess mounds.” 








FIGURE 1 ; 
4 Frames depicting state marker distributions over 4 consecutive occasions (N= 17, 18, 19, 20) in atypical hotlist 


’ 


learning strategy. Topics are represented by the circular ‘O’ nodes, analogical topics by the diamond shaped‘ 
nodes. States are indicated by shading as follows: Understood= J; Goal= PM; Aim= (J. Explore transactions are 
shown as ‘e’ marks at the periphery of the nodes explored. This student entered the entailment structure by ‘explain and 
derive ’ transactions, some of which are situated at a considerable distance from the lowermost * primitive ’ topics and 
such a behaviour is typical of some holists and some serialists. Whereas the holist typically has several goals and an aim 
ahead of them, the serialist learning strategy is typified by one goa/ at once, the goal topic often coalescing with the aim 
topic. Serialists usuafly rely less upon analogy relations, and are prone to cluster their exp/ore transactions at the start 
of learning rather than continuing with exploration throughout the process. 
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In fact, neither order of discovery nor gentleness appear as data in the 
conversational domain. Both predicates are invented, but later they acquire 
meaning and serve as adequate personal discriminators which assist in describing 
real differences. : 


(3) Since the holist/serialist classes can be specified within the theoretical 
framework of the earlier paper (Pask, 1976), it is also possible to distinguish 
teaching strategies which belong to one class or another. A teaching strategy 
may be embodied in programmed texts, lectures, or books, or alternatively it 
may be built into a regulator such as a teaching machine. 


(4) Normally students receive subject matter presented in only one partic- 
ular way, yet they consistently prefer a particular type of learning strategy, when 
given a choice. If the teaching strategy is matched to the same type of learning 
style (e.g., holist/serialist), the student will learn more quickly and retain the 
information for longer. Conversely a mismatched condition leads to grossly 
inferior performance and a pronounced failure to comprehend the principles 
underlying the subject matter. 


(5) Iflearning takes place in a controlled system (CASTE or INTUITION) 
the disparity between matched/mismatched instruction is dramatic. Mismatched 
students acquire hardly any relevant knowledge. Performance over a group is 
enhanced if the tutorial system is designed to achieve matched conditions by 
‘ learning ’ about the individual student and recommending matched procedures 
which also retain the student’s level of uncertainty within limits. 


(6) An incidental finding is that competence in using a strategy does not 
always go alongside disposition to adopt it. Some students are disposed to adopt 
a strategy they cannot use effectively enough to satisfy the understanding 
criterion. Asa rule, these students feel they ‘ ought’ to adopt a serial approach. 
There is a strong institutional bias to structure material in this manner and most 
examinations favour serial recall. These individuals cannot learn subjects at a 
‘ deep level ’ (Marton and Saljé, 1976) unless they are introduced to, and employ, 
a holist strategy. The converse disbalance (students who feel they ought to take 
a global view but are adept serialists is less common,but has been observed). 


THE PRESENT STUDY 

Introduction 

The hard core of evidence on learning style is due to Bruner ef al. (1956), 
Guilford (1956), Kagan (1965) (the impulsive/reflective distinction) and Witkin 
et al, (1975) (field dependence/independence). There is a body of more recent 
work which includes work by Thomas (1971), on reading style; Dirkzwager 
(1974) on style in logical problem solving; Klix (1971) on concept acquisition; 
Tversky and Kahneman (1974), and Strub and Levit (1974) on decision style; 
Hankins (1974) on styles exhibited by engineering design students; and Elshout 
and Elshout (1969) on styles of creative reasoning. Protocol investigations by 
Newell and Simon (1972) on thinking, and Landa’s (1974) experiments on logic 
and language learning, clearly exhibit distinct styles. Other studies include Bree 
(1974), Allen (1974) and about one fifth of the papers contributed to a conference 
on ‘ Structural Learning ’ (Scandura, 1974). The notion of style, in contrast to 
its empirical demonstration, goes back to antiquity (see, for example, Yates, 
1966). Moreover, differences in style can reliably be detected outside the 
laboratory, most dramatically, perhaps in the way people explore, learn about, 
and perceive their environment (Lynch, 1960; Glanville, 1974). 
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The ‘ holist/serialist ’ distinction (Daniel, 1975; Pask and Scott, 1971, 1972) 
is an example of different learning strategies, rather than the more generally 
exhibited learning style. The holist or serialist strategies are exhibited in a 
‘ strict conversation,’ and are thus insufficiently refined to account for learning 
in general. Holism and serialism appear to be extreme manifestations of more 
fundamental processes, which are induced by systematic enforcement of the 
requirement for understanding which is as strong as, or stronger than, the 
requirement for ‘ deep-level’’ processing (Marton and Saljé, 1976). If the strict 
understanding condition is relaxed, as it is in class tuition or self-study, some 
students are disposed to act ‘ like holists ’ (comprehension learners) and others 
‘ like serialists ’ (operation learners), with more or less success. There are also 
students able to act in either way, depending upon the subject matter, and if 
they excel in both pursuits, we refer to those students as versatile. It is these 
distinctions which can, more appropriately be referred to as learning style. 


The gist of this comprehension/operation distinction is as follows: compre- 
hension learners readily pick up an overall picture of the subject matter, for 
example, redundancies in a taxonomic scheme or relations between distinguished 
classes and recognise clearly where information can be obtained. These individ- 
uals are able to build descriptions of topics and to describe the relation between 
topics. Their cognitive repertoire includes effective, though individually 
distinctive, description building operations, although such learners may not be 
able to apply these operations to specific subject matter information (for example, 
to classify specimens) until the procedures underlying the concepts in question 
are specifically taught. 


Left to their own devices, operation learners pick up rules, methods and 
details, but are often unaware of how or why they fit together. They have, at 
most, a sparse mental picture of the material and their recall of the way they 
originally learned is guided by arbitrary number schemes or accidental features 
of the presentation. On the other hand if an operation learner is provided with a 
specific description (by external means) he assimilates procedures and builds 
concepts for isolated topics. His cognitive repertoire includes accessible or 
effective procedure building operations. 


Whereas holist and serialist strategies belong to distinct classes (because of 
the restrictions imposed by the apparatus), it is emphasised that the comprehen- 
sion/operation learning distinction is a matter of degree. The point is important 
because it can be shown, on empirically supported theoretical grounds, that 
both description building and procedure building operations are prerequisites for 
understanding any topic. In the experiments which are described below it is 
necessary to identify in advance students likely to adopt serialist or holist 
strategies within the conversational systems. Students can be so classified either 
by a trial run through a conversational domain, or by using an appropriate test 
designed to assess biases towards operation learning, comprehension or versa- 
tility. (Such a test, the ‘Spy Ring History’ test, is described later). It is then 
possible to assign students to materials which are designed for the same (matched 
condition) or for the opposite (mismatched condition) learning style. 


FIRST SERIES OF EXPERIMENTS 
Methods 
The first series of experiments was carried out to replicate and extend some 
of the main findings already described, using a larger sample of students, slightly 
less restrictive circumstances and much more varied subject matter. The design 
(Figure 2) involves a Free Learning condition using a semi-mechanised arrange- 
ment for recording and display. Students are free to aim for topics and to explore 
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topics (obtaining information about topics by slide projection) and they are free 
to work on topics provided on information cards which they can cluster together 
(similar to, but not identical with, working upon several goals in the CASTE or 
INTUITION system). The understanding condition is not‘enforced, but students 
must adopt some learning strategy and the few who failed to do so (less than 10 
per cent of the original sample) were rejected. All transactions had to be 
accompanied by a statement of intention or purpose within the classification 
headings of Table 2. An on-line index of success is obtained and the experimenter 
is thus able to persuade students to adopt a strategy they are competent to 
execute. 

Another condition in the design is Teachback (noted in the previous paper, 
as one method of securing understanding and, at least, deep level, processing). 
The teachback condition is balanced by dummy or ‘ ineffective teachback ’ in 
which, though the administrative ritual is similar, the demand for understand- 
ing is replaced by meeting a less stringent correct response criterion. Students also 
learn from a programmed text designed according to holist and serialist teaching 
strategies and are periodically pre- and post-tested. The subject matters employ- 
ed for style-assignment (comprehension, operation, versatile) and for learning 
were the two taxonomies of imaginary animals (‘Gandlemullers’ and ‘ Clob- 
bits ’) used in earlier studies (Pask and Scott, 1972), two biological subjects (the 
operon and the menstrual cycle) and an inductive inference task (Tech. Rep., 
1973). All of these were prepared as conversational domains in the way described 
in the previous paper. 


Sample 

The experimental design is shown in Figure 2. The sample consisted of 62 
students from two polytechnics sub-divided into two groups. The first group of 
32 students was asked to work through the ‘ Clobbit ’ taxonomy Free Learning 
task and each student was then classified as tending towards comprehension or 
towards operation learning. With an interval of approximately two weeks, 
subjects returned first to work through the ‘ Gandlemuller’ taxonomy task in 
either a ‘matched’ or a ‘mismatched’ condition, and then to tackle the operon 
cycle task in a ‘ matched’ or ‘ mismatched’ condition. Teachback protocols, 
indicating learning strategies, were elicited for all tasks completed on earlier 
sessions, and retention tests were given each time a student returned for further 
sessions. Different subgroups received either ‘ effective’ or ‘ ineffective ’ 
teachback. 

The second group of 30 students was treated similarly, but, for them, the 
free-learning task was the menstrual cycle and the two programmed text tasks 
were the operon cycle and probabilistic inference. All students in both groups 
returned later for a final session of retention tests and teachback. As shown in 
Figure 2 the distribution of matched/mismatched instruction and effective/in- 
effective teachback are balanced by alternation within the strategic classification 
and within groups. Each session lasted from five to six hours, so that the 
complete experiment occupied between 20 to 24 hours for each student. 


Results 

The most discriminating ‘ objectively scorable ’ indices of learning style are 
the ‘ intentions ’ underlying each free learning transaction, the mean number of 
data cards clustered for working on under one aim topic, and the student’s correct 
certainty (6) and uncertainty (H) about topics addressed and those lying ahead of 
their current aim topic (H*, 8*) (Table 2). A less discriminating prediction is 
obtained from the frequency of repetitious explorations and the extent to which 
immediate ‘ teachback ’ order recapitulates the order in which items are address- 
ed during ‘ free learning.’ 
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FIGURE 2 = 
Experimental Design. Note: the design receives a balanced combination of matched we 


(M) and mismatched (U) instruction and of effective (E) and ineffective (I) teachback (TB), for 
students classified as (comprehension learners like holist—LH) or (operation learners, like 
serialists—LS) after free learning (FL). Different initial subject matters (the Clobbits taxonomy 
CL and a menstrual cycle MC) other abbreviations are GT for Gandlemuller ‘Taxonomy 
OC for Operon Cycle and PI for probabilistic inference. Q means * Questions Test ’ (including 
explanatory questions) and ‘TQ’ is test questionnaire for long term recall. 


TABLE 2 


SUMMARY OF DATA FROM FREE LEARNING SESSION. 


9€T 


Frequency of Intention types ‘ Uncertainty and Correct Belief 
Vv 


Student Group 


Group 1 
Operation learners .... 


(N=18) 


Group 1 


Comprehension learners 
(N=14) 


Group 2 
Operation learners .... 


(N=17) 


Group 2 | 
Comprehension learners | 
(N=13) 

| 











Statistical summary: Key Intention types: 
Frequency of intention classes IV and VI: I=exploratory perusal of cards. 
comprehension learners> operation learners (P<0-001). Il=general search for information. 
Mean No. of cards/cluster: I1i=looking for a particular piece of information. 
comprehension learners > operation learners (P<0-001). IV=looking for several pieces of information. 
Operation learners have significantly higher means for 9(P<0-01). V=testing a single predicate hypothesis. 
Comprehension learners provided values for H* and @* on ~ VI=testing a mult-predicate hypothesis. 
significantly more occasions (P<0-01). (All comparisons by 
Mann-Whitney U-test). Uncertainty and Correct Belief: 
H=Uncertainty. 
H*=Look Ahead Uncertainty. 
@—Correct Belief. 
@* =Look Ahead Correct Belief. 
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Apart from the original assignment, retrospective determination of style 
was carried out in those phases of the design (Figure 2) devoted to ‘ teachback ’, 
using a content analysis of the tape-recorded ‘teachback’ protocols. This 
assessment of style was based upon the conversational domain for the subject 
matter in question, using six statement types; falsehoods; inventions; requests 
for information; deductions; irrelevant statements; and redundant statements. 
Judged by the Mann-Whitney U-test the frequency of inventions, requests, and 
deductions for the comprehension (holist-like) learning groups is greater than 
the frequency amongst the corresponding operation (serialist-like) learning 
groups (in each case P<-001); Irrelevant and redundant statements are more 
frequent amongst mismatched than matched operation learners (P< -001) and 
as might be expected, mismatched students utter more falsehoods than matched 
students (P< -001). 


The influence of matched/mismatched instruction was determined by 
questionnaire retention tests and Table 3 shows percentage scores on the relevant 
tests. The influence of effective/ineffective teachback (understanding required 
or merely a correct response criterion) was determined by comparing pre-teach- 
back and post-teachback scores (Table 4). Both ‘ matching/mismatching ’ and 
‘understanding/no necessary understanding’ conditions influence both the 
stylistic and the teachback data in ways that are best understood by examining 
the lengthy tabulations obtained for individual students. These tabulations are 
available on request, or in Tech. Rep., 1973, but the data has had to be summar- 
ised for publication here, 

TABLE 3 


SUMMARY OF RESULTs FoR STUDY OF EFFECTS OF MATCHING/MISMATCHING, 


i Matched | Mismatched Matched | Mismatched 
Student Group Condition with with with with 


Gandlemuller|Gandlemuller} Operon Operon 
programme | programme | programme | programme 


Group 1 Le det 90-9 33-0 90-8 34-9 

Operation ; 

learners 3-7 8-4 3-8 
(N=9) (N=9) (N=9) 


Group 1 weed 910 45-6 47-0 
- Comprehension 
learners 36 6:3 


5-4 
(N=7) (N=7) (N=7) 


Matched | Mismatched | Matched | Mismatched 
with with with with 
‘Student Group Operon Operon _| Probabilistic | Probabilistic 

programme | programme | Inference Inference 
programme 














Group 2 
Operation 
learners 


Group 2 
Comprehension 
learners 


Statistical summary: ‘ 
1, Each student’s matched performance> mismatched performance (P<0-001, Wilcoxon 
Matched Pairs signed ranks test). 


2. Aggregate difference; matched task scores>mismatched task scores (P<0-001, Mann- 
Whitney U-test). 
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TABLE 4 


SUMMARY OF RESULTS FOR STUDY OF RETENTION UsING EFFECTIVE AND INEFFECTIVE TEACHBACK. 





Student Group Effective teachback Ineffective teachback 
on Gandlemuller on Operon. 
Programme Programme 
' Group 1 
’ Operation learners ........ Mean 99-0 38-0 
‘(N=9) SD. 5°4 12:2 
Group 1 
* Comprehension learners ..| Mean .. 101-1 56:0 
= sD. 7-1 8-8 
Ineffective teachback | Effective teachback 
on Gandlemuller Operon programme 
programme 
"Group 1 ; 
Operation learners ........ Mean .. 51-0 109-0 
(N=9) SD .... 12-1 5:2 
Group 1 , 
Comprehension learners ....| Mean .. 57-0 104-0 
== : SD .... 98 6: 
Effective teachback | Ineffective teachback 
on Operon programme| on _ probabilistic 
inference 
: Group 1 
Operation learners ........ Mean .. 84-1 47-9 
= SD .... 26-4 19-9 
; Group 2 
: Comprehension learners ....| Mean .. 98-7 71-0 
: N=7) SD .... 23-9 16-1 
Ineffective teachback | Effective teachback 
i on Operon programme on probabilistic 
} inference 
Group 2 
- Operation learners ........ Mean .. 40°1 103-5 
i (N=8) SD .... 13-9 13:8 
Group 2 
, Comprehension learners ....| Mean .. 62-0 116-0 
| (N=6) : SD .... 13-1 30°8 











Note: Post-test teachback score is represented as a percentage of the pre-test score. 


Statistical summary 


Each student’s effective teachback results >ineffective teachback results. Differences are 
significant for all students (and for all operation and comprehension learners treated as separate 
sub groups) (P<0-001, Wilcoxon Matched pairs signed ranks test). 


The results from this experimental series clearly confirm those of the earlier 
study. Matched instruction favours learning and mismatched instruction 
completely disrupts it (specifically, for explanation eliciting questions) and leads 
to specific types of misconception. The demand for understanding guarantees 
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retention, whereas the correct response criterion does not usually do so. (A 
finding similar to that reported by Marton and Saljé, 1976, in terms of deep and 
surface level processing). Differential learning strategies are adopted and if 
students are assigned to holist/serialist classes on the basis of their comprehen- 
sion/operation learning competence, then the learning strategies polarise and 
transfer over quite widely spaced (two-week) sessions involving different subject 
matter. 

Tn these experiments all students were also given standard tests for various 
cognitive traits (logical reasoning, embedded figures, analogy completion, 
perceptual discrimination and a test for divergence). The only differences in 
mean score between groups (holists score higher than serialists, P<0-05) are on 
the analogies test and the divergence test. 


SECOND SERIES OF EXPERIMENTS 
Methods and Sample 


The various methods being used in the second series of experiments are as 
follows: 


(a) Intensive tape-recorded individual interviews and small group discus- 
sions with teachers. 


(b) Material reported in this paper is based upon over 80 interviews with 
students, of which 46 were mainly concerned with reaction to INTUITION (as 
in the previous paper). 

(c) The INTUITION system programmed for a thesis on probability 
theory and decision. The laboratory-like modelling-facility is STATLAB 
(previous paper). This technique provides exceptionally detailed automatic 
records of all the learning transactions. 


(d) ‘ Free Learning’ and ‘ TEACHBACK ’ using a modelling facility for 
heat engines and an appropriate conversational domain. 


(e) Approximations to INTUITION and TEACHBACK, based on 
conversational domains for different subject matters, but allowing for group and 
classroom operation. 


(f) Techniques for studying innovation, ‘ teaching people to learn’ and 
inducing ‘ learning to learn’. 


(g) A specific test, the ‘Spy Ring History ’ test was developed during the 
first series of experiments to provide a convenient method of estimating an 
individual’s bias towards operation learning, comprehension learning, or 
versatility. The test is described in Tech. Rep., 1974, and the Appendix. Admini- 
stration occupies between one and two hours and students are required to learn 
and recall the growth of an ‘ International Spy Ring’ over five historical epochs. 
Recall questions are loaded to favour operation learning, comprehension 
learning or neither. Percentage scores are calculated as comprehension bias/ 
operation bias, versatility, and overall success. The test has been administered 
to 65 students (Sth and 6th form) at Henley Grammar School, 40 from the 
Architectural Association school of Architecture and over 50 from other schools 
and colleges. Of these, 23 students subsequently used the INTUITION system 
so that an unambiguous learning strategy record is available for scrutiny and 
there is a significant (P<0-001) positive correlation between the comprehension 
score and indices of holism, with the operation score also being related to indices 
of serialism. 
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RESULTS 


Comprehension learning, operation learning and their defects 

Comprehension learners, operation learners and versatile students who use 
both modes of learning (as judged by results from the Spy Ring History test) 
appear to tally with mental propensities noted in the course of interviews with 
both teachers and pupils. Certain pathologies of learning are also consistently 
acknowledged by a large number of tutors and schoolteachers, and many of these 
are predictable consequences of unsuccessful comprehension learning and 
unsuccessful operation learning. Two outstanding pathologies have been 
christened globetrotting and improvidence. 


Globetrotting and improvidence are most easily exhibited in the context of 
analogy relations such as the correspondence between an electrical oscillator and 
a mechanical oscillator, an example used in the previous paper. This, like any 
other analogy representable in a conversational domain, is a valid analogy, 
i.e., there is a systemic/formal principle (simple harmonic oscillation) in 
common to the analogous topics and there are differences of semantic inter- 
pretation (for example, the distinction between an electrical and a mechanical 
oscillator). Moreover, the analogy relation only ‘ works’ if the proper cor- 
respondences are recognised between the subordinate topics (mass/inductance; 
elasticity/inverse capacitance and friction/resistance). Other subordinate 
correspondences which might be imagined would lead to inconsistency and a 
misunderstanding of the valid analogy. There are also vacuous analogies where 
two or more topics are described and believed to have a systemic/formal 
principle in common, but do not actually have one. The following example 
exhibits the use (not the understanding) of a vacuous analogy. A students says 
‘* A termite’s nest is like an ant hill and an ant hill is like acity”. Asked what 
a city (termite’s nest) is like he says “an ant hill”. Asked what an ant hill, 
or termite’s nest is like, he may or may not be able to give an explanation; for 
example, “‘ a social organisation of insects employing signalling devices, mostly 
chemotactic, and constrained by architectural pathways...”. If not, his 
construction is tautologous. If so, he has still appreciated a vacuous analogy if 
the same explanation does not characterise the other two topics, i.e., if asked 
** how does that organisation apply to a city ” he is unable to reply, or if his reply 
is factually mistaken. Finally, there are students who fail to make use of valid 
analogies thatdoexist; forexample, it is not uncommon for students to learn the 
concept of an electrical oscillator and (even though they are told and genuinely 
appreciate that the same formal equations govern mechanical oscillators) to 
learn about mechanical oscillators from scratch. Nearly all the effort could have 
been saved, if the common principle had been used (rather than merely verbalised 
as a formula). The phenomenon is ubiquitous, especially in cross-disciplinary 
studies. It is deprecated, but not avoided. 


Globetrotting may now be defined as the misunderstanding of valid analogies 
the use of vacuous analogies or both, while improvidence is failure to use valid 
analogies, failure to use a common principle, or both. The Spy Ring History 
test has a well specified entailment structure which is rich in correspondences 
that, if interpreted, become analogy relations; for example, between spy roles, 
between countries, and between the networks of different epochs. Hence it is 
possible to count the ‘ globetrotting ’ and ‘ improvidence ’ errors of respondents 
and to correlate their frequency with the test scores. There is a positive rank- 
order correlation (r=0-30, P<0-05) between the comprehension score and 
globetrotting errors and a positive rank correlation (r=0-26, P<0-05) between 
the operation scores and improvidence errors. If versatile students are removed 
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from the sample (to yield a residue of successful/unsuccessful comprehension/ 
operation learners) these error correlations are increased. They are still further 
increased by limiting attention to the less successful students who committed 
more errors of any kind. For example, amongst students scoring less than 70 per 
cent, the correlation between comprehension score and globetrotting error is 
0:57 (P<0-01) and that between operation score and globetrotting errors is 
0-55 (P<0-01). Preliminary work on the analysis of essays written by students 
who have performed the test, indicates that even higher correlations exist be- 
tween the comprehension and operation scores and the frequency of errors 
due to globetrotting or improvidence. 


Studies of learning probability theory using the INTUITION system 

' The general findings of the previous laboratory studies have been confirmed. 
The detailed records of learning (18 to 26 hours learning time per student, 
excluding test time and interviews) always show polarisation. Further, if the 
choice of learning strategy is guided by advice based on knowledge of learning 
styles, then the learning is effective and understanding leads to retention. 


Altogether, 56 students have used INTUITION. Due to the difficulties of 
operating a system within institutional timetabling constraints (for example, 
‘ break points’ must occur at change of an aim topic; if this self-paced event 
does not fit into the timetabled period, much, or all, of the record must be 
discarded) summary performance data is presented in Table 5 (I) only for 11 
carefully studied A-level students at one grammar school where the restrictions 
are less severe. (The remaining results are available on request.) Detailed 
records of learning cannot be concisely displayed but are made in each case. 
For example, Figure 1 shows fragments (less than a tenth) from the record of a 
holist (caption for serialist) in the group of 11 students. Apart from the inform- 
ation shown in Figure 1, the system records the progress of aim validation (as 
confidence estimates) explored topics, and the steps taken to remedy mis- 
taken explanations. 


Studies of the mechanisms underlying defective learning 

As characterised by the Spy Ring History test, comprehension learners 
are prone, if left to their own devices, to act as holists. Operation learners are 
more likely to act as serialists. The versatile students have initially a greater 
degree of freedom, but their behaviour becomes polarised after they have tackled 
about a dozen topics. All students who manage to learn, do, by one means or 
another, reach the understanding demanded by the standard condition. This isa 
consequence of two facts. The operating ritual is devised so that they must do 
so, and the conversational system provides the information needed in order that 
they may do so. 

‘Our hypotheses about defects in learning stem from these facts and the 
‘premise that understanding a topic, in the strict sense of the previous paper, 
involves both comprehension learning, which was identified earlier with descrip- 
ion building, and operation learning, which was identified with procedure 
building. This premise depends upon the idea, which appears self-evidently true, 
that any organisation, human, animal or mechanical, which builds programs 
or procedures on the basis of other programs or procedures, can operate 
efficiently only if it is first given, or constructs, a description of what the procedure 
to be built must do and the circumstances under which it will be executed. The 
alternative process of trial and error combinations of existing procedures, which 
depends on the elimination of the many combinations which do not work, is so 
grossly inferior as to be impracticable, except for a very restricted type of task, 
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TABLE 5 


PERFORMANCE OF STUDENTS UNDER LEARNING CONDITIONS WITH VARYING DEGREES OF CONTROL. 
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Statistical Summary: 


Test Score (1) > Test Scores (II) or QI). P<0-001 (Mann Whitney U test). 

Time/topic (I)<Time/topic (If) or (II). P<0-05 (Mann Whitney U test), _ : 

For (J) on transfer data: Time for Module 1 >time for Module 2 (P<0-01, sign test). Mistakes for Module 1> Mistakes for Module 2 (P< ‘01, 
sign test). 

For (II) significant positive rank correlation between individual comprehension/operation learning index and individual globetrotting (P<0-001) 

For (IID) significant negative rank correlation between individual comprehension/operation learning index and individual improvidence (P<0-05) 
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In the previous paper a concept for a topic was defined as a procedure for realis- 
| ing that topic. Thus understanding a topic (the construction of a stable and 
, memorable concept) nearly always involves a phase of description building and a 
phase in which a procedure (i.e., a concept) is built to realise the description. 
This type of, perhaps, ‘ deep-level ’ processing appears to be the dominant mode 
of human learning, although in animals the trial and error combination may be 
more significant. If this view is accepted, then understanding a topic involves 
both description building (comprehension) and procedure building (operation 
learning) as suggested. 


eat ee Does 


... As we have seen the standard condition of a conversational system demands 

i that topics are understood. Further, the system provides differential support. 
The entailment structure and its description, perceived through the ‘explore’ 
transactions, aid the student in building a topic description, while the demonstra- 
tions derived from the behaviour graphs attached to each topic, furnish prescrip- 
tions for procedure building. When the understanding condition is satisfied it 
follows (both theoretically and empirically) that neither of the two pathologies 
described earlier can be present. The explanation component of understanding 
prevents ‘ globetrotting’ while the derivation component inhibits ‘ improvi- 
dence ’ and prevents total improvidence. 


In order to investigate these pathologies the constraints upon the conversa- 
tional system must be relaxed. One approach is to replace the requirement for 
explanation of a topic, by requiring only correct responses to some six or eight 
multiple choice questions that span the topic. This criterion can then be 
achieved by a less thorough understanding; even by ‘surface processing’ in 
Marton and Siljé’s sense. A second approach involves reducing the support 
provided by the conversational system. When this is done various defective kinds 
of learning become possible, and can be investigated. These pathologies would 
also be found under classroom self-study conditions where again the ‘ under- 
standing ’ requirements are not stringent and there is little control of the learning 
process. 


Two conditions of this type have so far been investigated. 


(a) Explanation is replaced by a correct response criterion, but the entail- 
ment structure remains intact. 


The prediction under this condition is that comprehension learners, who are 
not versatile, will exhibit ‘ globetrotting’. The summary data in Table 5 (ID) 
supports this hypothesis and the expected tendency is strongly evidenced by the 
detailed records. For example, examination of the exploration patterns and aim 
selections reveals a distinction between the global and local types of description 
noted earlier. 


(b) Explanation is replaced by a correct response criterion and the entail- 
ment structure is denuded of all analogical relations. 


The prediction under this condition is that operation learners who are not 
versatile will exhibit ‘ improvidence ’, since they are no longer supported by an 
adequate descriptive scheme. The evidence that this hypothesis is also supported 
is presented in Table 5 (IID. 


In contrast, versatile learners are not greatly influenced either by relaxing the 
constraints or differentially withdrawing support. It appears that they habitually 
learn by understanding whether forced to do so or not. 
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Transfer and Learning to Learn 

' An appreciable transfer of learning takes place due to experience in CASTE, 
INTUITION, or Teachback over a conversational domain. The gross results 
shown in Table 1 and Table 5 conceal an important underlying transfer of 
general aptitude, due to the fact that a student learns a great deal about his own 
mental processes. This aptitude appears to transfer from one subject matter to 
another (for example, ‘ probability theory ’ to ‘ heat engines’) and scrutiny of 
detailed records such as those illustrated in Figure 1 suggests that it constitutes 
an increase in versatility. Recent data obtained by pre- and post-testing with 
different forms of the Spy Ring History test, are not at odds with this proposition. 


Can ‘ gaining versatility’ be equated with ‘ learning to learn’? and as a 
practical consequence, can ‘ conversational experience’ thus be regarded as 
‘ training the skill of learning ’? If the environment of knowledge and events was 
structured like a conversational domain, or even like the scholastic environment 
of libraries and educational media, the reply would be affirmative. But the usual 
connotation of ‘ learning to learn’ also comprehends an ability to structure and 
make sense of otherwise unordered experience. For this, more than versatility 
is required. What is required is the skill of building up an approximation to a 
personalised conversational domain. Understood in this way ‘ learning to learn ’ 
could have great practical value in education. 


A_Classroom Implementation of ‘ Learning ot Learn’ Principles 

Pilot studies have so far been limited to intensive study of 24 students from 
the sixth forms of two schools and from a college of education. Four separate 
groups have been used. The experiment occupies five sessions, each of approx- 
imately two hours duration. In the first session the students in a group are 
confronted with the following situation. They are to imagine that they have 
entered a course entitled Cosmic Processes (any other non-commital but interest- 
ing title would do, just as well) but have failed to attend the lectures. Today they 
are due to take a chiefly explanation/essay type of examination and have a 
couple of hours in which to scan through relevant test materials (X). With this 
‘ story ’ the students are given meaningful extracts from diverse authors (Bateson, 
Castaneda, Jung, Kelly, Lilly, Schrodinger, Wittgenstein). There is far too much 
to learn but the underlying topics can be related in many coherent ways. Towards 
the end of the first session each student is provided with a sheet displaying the 
names of 35 salient topics, arranged as a ring; further topic names may be, but 
rarely are, added. (All additions made as a result of pilot studies are entered on 
this list.) Each student marks with a ‘ plus’ sign those topics he feels certain he 
could explain and with a ‘ minus’ those topics he certainly could not explain. 
He is asked to connect topics, which he believes to be related, by ‘ links ’ to form 
an associative network. After that, students undertake an examination. 


The second session starts off with the delivery of computer processed 
graphics, derived from the ‘ network ’ from the first session. Training in general 
learning habits is given and is based upon the personal graphics and upon 
different, though similarly diverse, texts. The training, which extends into the 
third session if necessary, is a non-technical presentation of principles derived 
from CASTE (for example, reaching the understanding of a topic) discovery of 
defects such as ‘ globetrotting ’ and their remedy, and principles of subject matter 
structuring (building a conversational domain) which stem from the operation 
of ‘ course assembly systems ’ (Pask, 1976). Although these principles are quite 
definite and can be stated rigorously, they are presented in a non-technical manner, 
using exercises and a study guide which students are free to take away. 
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“The fourth session is a repetition of Session | using an again different set of 
text materials (Y). Both X and Y were chosen as bundles of material dealing 
with very different topics, each bundle being superficially unordered but each 
open to structuring in many self-coherent ways. The reading time and scoring 
time for materials X and Y (used in sessions 1 and 4) are matched. (The position 
of X and Y has been changed around with different pilot groups and the content 
of X and Y, though different, appears to present about the same degree of 
difficulty.) At the end of the fourth session relevant topics are marked with plus 
and minus signs and a further associative network is drawn by each student. 
After that the students submit to an examination covering all topics on the sheet 
describing the network elicited. 


At the beginning of the fifth session students receive a computer processed 
form of their associative net; being a graph representing how they individually 
relate topics in Y. Discussion is encouraged. Finally, all students perform the 
Spy Ring History test as a stylistic discriminator. 


During pilot studies (using a dozen paid respondents) a baseline control 
condition was established. The second and third sessions were devoted to learn- 
ing and examination of the materials currently used for training but with no 
specific training or study guide provided. Under these circumstances, learning 
performance does not improve and usually flags off, due either to cumulative 
overload or an initial Hawthorne effect. 


For the experimental condition it is possible to compare topic relating 
graphs for the two topics X and Y, the ‘ plus ’ topics for X and for Y, the number 
of * plus ’ topics that are actually explained in the examination, and the examina- 
tion scores for X and for Y. The tendency of the control condition is usually 
reversed (Mean examination score (Y)> mean examination score(X) is significant 
P<-01). So far, all students have been conservative in marking ‘ plus’ topics 
(i.e., they are able to explain ‘ plus’ marked topics), but the number of ‘ plus ’ 
marked topics increases with training(P< -05). Graphconnectivity, determined by 
several graph decomposition indices (Ashby, 1964; Atkin, 1973), significantly 
increases (P< -001) with training, whereas in the control condition there is a 
significant decrease. These objective indices support the consensual opinion 
gained from discussions that trained students gain a general insight into structur- 
ing and learning an unordered and previously unknown collection of topics. 
There are, however, exceptions to this general trend. First, there are students 
with a uniformly high examination score for X and Y materials (8 out of 24 in the 
sample studied.) These students, who are apparently able to learn from the 
outset, always have high (45 per cent or greater) versatility scores and there is an 
increase in the connectivity of their topic relation graphs. Next ,there are students 
(3 out of 24) who fail completely, their examination score for Y material being 
less than the score for X material. In the sample studied these students have a 
bias to operation learning, a low versatility, the graph connectivity for Y topics 
is less than that for X topics (in fact their Y graphs are fragmented into small 
sub-graphs), and their confidence in being able to explain topics also decreases. 


The important conclusion to be drawn from this final experiment to date in 
this on-going research programme is that it is possible, with a few exceptions, 
to teach students to learn more effectively by the application of sophisticated 
principles of learning. The principles can, however, be presented in a simple, 
non-technical manner suitable for use in a classroom. 


- Current research is looking at the problem of generalising from X materials 
to Y materials and vice versa, and also at transferring academic subject matters 
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into a self-study form. In general the research reported in this series of experi- 
ments has developed the ideas on conversational techniques of learning to the 
point where important practical implications for education are beginning to 
emerge. : 
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APPENDIX 
THE ‘SPY RING HISTORY’ TEST 


The ‘Spy Ring History’ test for Comprehension/Operation learning has ante- 
cedents in the work of Hayes (1965) and Michon (1966) upon learning lists of ordered 
pairs. Names in the lists denote spies, and pairing their connections (Boris, Abel), for 
example, means that Boris can communicate with Abel. Taken as a whole the list 
specifies a spy network (i.e., a directed graph, with spies at the nodes and arcs indicating 
who can communicate with whom). Respondents may or may not be able to build upa 
visual image of the graph if the name pairs are presented and learned in sequence, 
though, if the network is shown graphically, it is easily grasped. 


The ‘Spy Ring History’ test is founded upon a cartoon or graph product 
(Winner, 1973), each graph representing successive spy networks in the years 1880, 
1885, 1890, 1895, 1900, during which organisational changes take place, some of them 
quite regular. (For example, the network falls apart, or there are ‘bottleneck’ situations.) 
Moreover, the spy names (or spy roles) do not change over the interval, and may be 
consistently assigned, by further predicates, to different imaginary countries (Ruritania, 
Dionysia and Olympia). 


Students are told, at the outset, that they are learning the development of a spy 
network interlacing the countries over the epochs specified. However, they receive 
information only in the form of paired associate lists of spy names, with the caveat 
that each list is to be faultlessly memorised. In later versions of the test, the lists of 
paired names are slightly redundant. They purport to represent a sequence of observed 
messages which are presented with the caveat that any list of what messages were sent 
at a given epoch covers all the messages that could have been sent (that is, the connec- 
tions permitted by the network of the epoch in question). Hence, in a formal sense, 
all students have the information needed to answer any question correctly. They also 
appreciate that questions of various kinds will be posed later on. 


After learning, students are questioned (see Tech. Rep., 1974) to elicit complete 
information about the entire history. Students are seldom able to provide all the 
information required; but they give what they can in one of at least two patterns. 
It also seems they learn in at least two different ways. 
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** Some students, classified as comprehension learners (potential holists), can answer 
synoptic questions like “‘ What went wrong with the spy system around 1885?” or 
eyen predictive questions such as ‘‘ Do you think that outstanding events are likely to 
be repeated in 1905; if so, why?.” Other students, classified as operation learners 
(potential serialists) focus upon the individual networks or even thé paired associate 
lists; for‘example, ‘‘ How could Abel communicate with Boris in 1890; by how many 
paths; what are they? ” or even ‘‘ Draw the spy network for 1890.” The scoring scheme 
taps each kind of knowledge differentially, so as to discriminate between comprehension 
and operation styles of learning; it also includes a score for neutral questions favouring 
neither. style. All students are required to answer each kind of question as well as 
intermediary enquiries like “ Draw the boundaries of Dionysia, Olympia, and Ruritania 
on a map.” and “ Say which of the agents belong to each country.” 


‘* Provided the overall and the neutral scores are high enough (which depends upon 
personalised group administration, or, at any rate, feedback to ensure that the lists are 
learned) it is possible to distinguish stylistic tendencies as follows: 

(a) Operation learners who are also successful in deriving general properties. 
(6) Operation learners who can recall details but cannot answer general questions. 
(c) Comprehension learners who also successfully derive details. 


(dq) Comprehension learners who recall the overall scheme but cannot answer 
particular questions. 


(e) Versatile students who correctly answer questions of each kind and apparently 
use several derivation methods. 














